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ABSTRACT 


Endoscopic endonasal transsphenoidal surgery (EETS) is a standard 
procedure to treat the pituitary adenoma, a tumor in the pituitary gland that 
causes malfunction of hormones. Although the method is substantially 
minimal invasive, the surgeon may encounter intricacies. The major 
challenges are narrow surgery pathway, limited working area, lack of case 
studies for practicing, steep learning curve owing to the intricate steps, and 
the tool insertion risk. To ease the neurosurgeons, this research focuses on 
the development and testing of the surgical simulator based on the pathway 
guidance and the interchangeable surgical instrument tooltip. The system was 
tested in human cadaver-based experiments with interchangeability in terms 
of function and the performance of the simulator in terms of the benefits. The 
experiments demonstrate the augmentation in the learning skill of the user 
through the simulator based on the completion time assessment and the error 
reduction. Furthermore, the satisfaction level of the interchangeable surgical 


tool, which was found using sliding switch and gripper scored 71.40%, the 
interchangeable tooltip function, which is a novel function to participants 
scored 85.6% and the practical use had 77%. The geometric aspect of the 
interchangeable tool scored lowest (62.80%) and was found to be moderate 
among the neurosurgeons. 
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1. INTRODUCTION 

Pituitary Adenoma is a slow-growing tumor of the pituitary gland, which is a major endocrine gland 
regulating necessary hormones. However, when the tumor cell grows irregularly, it might secrete excessive 
hormones which may result in a number of hormonal diseases and symptoms such as headache and vision 
loss. Basically, there are three methods available to treat the tumors: drug therapy, radiotherapy, and surgery. 
Regarding surgery, a technique based on natural orifices transluminal endoscopic surgery (NOTES) [1] 
known as endonasal endoscopic transsphenoidal surgery (EETS) [2], which accesses tumor through the 
sphenoid sinus from the nasal cavity, has gained considerable recognition. The EET surgical procedure [3] 1s 
initiated by the insertion of the sinus surgical tool along with an endoscope through the nasal cavity followed 
by the removal of the adenoma. 
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EETS technique has gained popularity mainly because of the reduced recovery time, no scars, and 
considerably low side effects [4]-[6]. Despite these advantages, the procedure is challenged by factors such 
as narrow surgical pathway [7] and limited working area. Therefore, it requires the expertise of a highly- 
skilled surgeon [8] in order to prevent the carotid artery, cavernous sinus, and optic nerve from any harm. 
These factors along with the scarcity of relevant cases hinder the training for the EETS procedure. Moreover, 
there is also a possibility of inexperienced surgeons conducting the surgery along the wrong pathway. As 
there is a lack of a specific tool for EETS, it compels the surgeon to change the tools frequently during the 
procedure resulting in numerous tool shifts. Based on the problems, this research focuses on a system comprising 
of a surgical simulator based on pathway guidance and a surgical tool with an interchangeable tooltip. 

To develop the novel surgical tool for EETS, the conventional tool in EETS has been taken into an 
account. Due to the narrow workspace [9], all the sinus surgical tools are tiny, long cylindrical, and light- 
weight, intended mainly for scarping and cutting the hindering bone or tissue. On the other hand, the 
reduction of the number of tool shifts can be achieved through the implementation of a single-port surgical 
tool. Compared to the Laparoscopic surgery [10]-[12], the single-port surgery relies on one incision for 
inserting multiple surgical instruments through the trocar-like tool [13], offering less invasiveness. For 
instance, the SILS™ Port is a multiple access port made up of an elastic polymer allowing flexible 
movement. In the direct drive system, the device is an articulated tube-shaped, attached with an endoscope 
and consists of a hole to insert another instrument [14]. From the concept of the single-port surgical tools, an 
interchangeable surgical tool was designed for EETS which is targeted at mitigating the aforementioned 
problems as well as reducing the invasiveness. 

In order to create a realistic scenario for the surgeon, the physical properties and the environment 
are simulated in the simulators by creating artificial sensory experiences through visual as well as touch 
sensation during the training [15]. Some of the surgical simulators adhere to similar functions are virtual 
training system in laparoscopic surgery (Labsim), orthopedic training (MAKO RIO), a training system for 
Endoscopic pituitary surgery [15], [16], Otolaryngology [17], and Nephrectomy simulator [18]. Most of these 
researches and products ponder upon the development of a realistic environment and material properties of 
tissue and bone, vision, and color of each organ. However, this research gravitates towards the aspect of 
pathway guidance. The working methodology begins with creating the pathway guidance simulator for 
evaluating the conceptual function of the novel surgical tool. Generally, the simulators can be separated into 
three parts: anatomical model, graphical software [18], and a haptic device. Image reconstruction software 
plays an important role in the process and calculates the virtual world based on the mathematical model to 
acquire the anatomical 3D model by applying medical imaging [19]. Many of the software has been launched 
such as 1tk-SNAP, Invesalius, 3D Slicer, and Osiris [19]. After comparing the performances, a 3D slicer has 
been chosen for creating the model using semi-automatic segmentation [20], to obtain the model of pituitary 
tumor and nasal structure [21], [22], which is exported into mesh model [23]. 

Within graphical software, the game engine [24] has been used for creating a realistically visual 
environment to display and sensation to interact with the user [25]. There is a glut of open source software 
such as Unity, PhysX, Unreal engine, and id tech [26] that can be used, for integrating medical data and also 
the physical and material properties of human anatomy. Unity is the most suitable platform due to the 
compatibility with the haptic device, computer-aided design (CAD) supporting, rendering performance, and 
an extensive parameter option for physical properties [27]. The final component within the simulator is the 
haptic device which is a peripheral device that provides a physical contact interface between the computer 
and the user [28]. In a surgical simulator, the surgeon can sense the imitated touch like in real surgery from 
the device which acts as the surgical tool. Occasionally, the device's handle is modified to attach the surgical 
tools to facilitate more specific practices [29]. In this research, the haptic device stylus is modified with the 
multi-surgic-tip tool, and the haptic interact model is developed for testing the conceptual design of the 
interchangeable tooltip surgical tool with participants who are experienced neurosurgeons. The interchangeable 
tooltip surgical tool is developed to overcome the tool’s shifting problem. 


2. RESEARCH METHOD 
2.1. Overview 

In this research, there are three main aspects, comprising of Haptic-VR surgical simulator for EETS 
pathway guidance as shown in Figure 1(a), interchangeable tooltip surgical tool, and the multi-surgic-tip tool 
as shown in Figure 1(b). The interchangeable tooltip surgical tool is a novel design surgical tool for EETS 
made to overcome the problem of numerous tool shifting during the procedure. To evaluate the conceptual 
design of the novel surgical tool, Haptic-VR surgical simulator for EETS pathway guidance is developed. 
The simulator can also be used for the practice of the motor hand control movement of the users by 
simulating the surgical environment. The multi-surgic-tip tool is a modified haptic stylus that attaches with 
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the handle of the interchangeable tooltip surgical tool. The tool provides the function and the appearance in 
such a way that both the evaluation and simulation can be performed. 


pT 


Endoscopic Endonasal Tranghenoidal Smutator 





(a) (b) 


Figure 1. BART LAB Haptics-VR surgical training simulation system, (a) EETS pathway guidance system, 
(b) SurgiSim-abdominal surgical training system 


2.2. The interchangeable tooltip surgical tool for EETS 

The design of the interchangeable surgical tool was performed in three steps. The first stage was the 
review of the design of the sinus surgical tool model and haptic device through the evaluation and assessment 
in terms of dimension, function, and mechanism. The major aspects of considerations were suitability with 
the procedure of EETS, the convenience of usage, and the functionalities of the surgical tooltip. The second 
step was the construction of the CAD model of the tool to conduct the motion study in Solidworks Motion 
Studies. The final stage was the generation of the mesh model of the tool and introducing the model within 
the simulator for the integration with the haptic devices. After the completion of these three stages, the 
Phantom Omni stylus was modified to evaluate the design with the participants who were some experienced 
surgeons in EETS. The interchangeable tooltip surgical instrument serves two functions. The first function 
targets to ease the switching of tooltips in a single instrument. It eschews the tedious insertion process 
through the sophisticated nasal pathway. Moreover, the overall procedure can be performed through a one- 
handed operation, which ensures convenient usage for the neurosurgeon. The second function is the punching 
mechanism that is activated specifically for the cutting tools. 

The design of an interchangeable tooltip instrument involves three mechanisms to facilitate the two 
functions as mentioned above. First, the tooltip extension mechanism, which is for the stretching and 
gathering of the tooltip during the usage and non-usage phases respectively and applied by a mounted scissor 
mechanism into a slide button. As illustrated in Figure 2, the scissor mechanism also provides a proportional 
stroke length during the sliding movement. Hence, this mechanism can maintain the dimensional integrity of 
the instrument to fit in a limited space in the human’s nasal cavity while making it possible for the switching 
of the tooltip by one-handed use. 

Secondly, the tooltip switching mechanism is used to change the two tooltips: Kerrison Rongeur and 
Ring Curettes. This mechanism consists mainly of retracting boxes and retract rod. The retract box is used for 
locking and unlocking the tool's position. The tooltip extension mechanism and the tooltip switching 
mechanism coordinate and collaborate. Lastly, the punching mechanism in this case uses Kerrison Rongeur, 
which performs like scissors for the cutting operation, and are also available in the conventional surgical tools. 


2.3. The EETS pathway guidance surgical simulator 
The virtual reality-based EETS simulator consists of three main components. The first component is 


the combination of the 3D data obtained from the real patients and the cadavers. These data include the 3D 
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mesh model of the nasal cavity acquired from the medical image data (CT scan of the real patients) and the 
pathway model obtained from the optical tracking sensor data (EETS pathway of the Cadavers). This step 
demands the image reconstruction software like a 3D slicer to select the area of the nasal cavity and nose skin 
in each medical image segmentation. Then the mesh model is imported into the CAD file to study about 
anatomical structure and position of the sphenoid sinus and the pituitary tumor which will be used as the 
environment of surgery in the simulator. For the pathway model, MATLAB is used to apply the statistical 
analysis data from sensors to find the average path for tool insertion. 


<€---------- 





Figure 2. Design of the interchangeable tooltip surgical tool 


The second component of the simulator is the haptic device which sends force feedback from the 
virtual world to the real world. It requires hardware called “Phantom Omni”, which enables the touching 
perception simulation. The last component is the game engine that conducts the interaction between the user 
and the virtual world by sending visual sensations and touch using Unity, which can simulate the 3D model 
of the nasal cavity and has a plugin for working with Phantom Omni device. Besides, the software will also 
act as a central processing unit, collecting both the position and orientation data from the haptic device and 
generating the tactile information for allowing the user to feel the force-feedback sensation. The CAD model 
of the nasal cavity, EETS pathway, and EETS surgical tool are imported as mesh models and the stylus of 
Phantom Omni is modified with the novel design tool. The virtual world of EETS tool insertion along with 
the nasal cavity model is shown in the display monitor. 


2.4. Creating the surface model 

In this simulator, four models are used as a surface boundary for the haptic device sensation. The polygon 
surface model or mesh model consists of the Nasal cavity (Visualization), Nasal cavity (Haptic rendering), Pathway 
line, and Head model as shown in Figure 3. To create the mesh model, the image reconstruction software is required 
to analyze the file type, digital imaging, and communications in medicine (DICOM). 





Figure 3. Polygon surface model in the simulator 
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The model presented is constructed from the high-resolution computational tomography (CT) 
images of the human skull with a slice thickness of 1.0 mm in 512x512 matrix to create the surface model 
with “3D slicer” [25]. The model is separated into two components: a high number polygon surface, which 
can cause a problem to the haptic device when calculating the force feedback, and a lower polygon model. 
The nose model is converted by “Blender”, a graphic software suitable for reducing the number of polygons 
while preserving the topology of the model. The experimental data of the optimum pathway for EETS from 
the related study that obtains the position of the tooltip movement was imported into Blender and a pathway 
was created. Finally, a circular surface is created along the path. 


2.5. EETS simulator 

The game engine software “Unity3D” is used to create a real-time graphical image and simulate the 
surgical environment. The advantages of using a game engine to create a surgical simulator are that the 
physics engine in the system can set the parameters such as gravity, velocity, friction, collision, and light to 
mimic the real world. Four surface models, as mention above, are imported into the game engine to use as 
material to create the virtual EETS surgery. The surgical simulator requires realistic visualization and 
sensations. In this system, tool action and perception interact with the user by a commercial haptic device, 
Phantom Omni (Sensable Technologies), with three degrees of freedom for force feedback to the user and six 
degrees of freedom for motion. Real-time position and rotation from the device are directed to the software 
using the Phantom Omni Plugin for Unity 5.0. 

The main features of the EETS Simulator software for the user are endoscopic views like a 
Sinoscope, operating scene from a third-person view, transparent nose model to show the position of the 
virtual surgical tool, and the information panel to show the time elapsed including the distance from the 
sphenoid sinus. The user can see the anatomical structure of the nose interior on the left side of the screen. 
During practice, the software generates a boundary from the polygon to limit the movement of the haptic 
device position and releases the force feedback to the user as shown in Figure 4. 


2.6. Experimental protocol for EETS simulator 

The subject in this study comprises of neurosurgeons and biomedical engineering students. 
Specifically, the seven practicing neurosurgeons are proficient in EETS while the fifteen biomedical students 
have no prior experience in EETS. The experiment was conducted and completed with practice on 3 modes 
which are novice, intermediate, and advance, consecutively as shown in Figure 5. 


Endoscopic Endonasal Tranphenoidal Simulator 





Figure 4. User interface of the EETS simulator shows Figure 5. Testing the pathway guidance surgical 
the endoscopic view on the left and navigation panel simulator with the participants at Ramathibodi 
on the right Hospital 


The practice was performed over three trials in each mode starting from the Novice step, which is 
the easiest level to the most difficult advance level. The advanced level closely simulates the situation in real 
operations. The modes have been classified based on the level of assistance the system concedes to the user. 
Specifically, certain criteria as mentioned in Table 1 are the basis for categorization. As mentioned, nose 
boundary refers to the sensation depicting the initial nose cavity boundary. The guidance force refers to the 
force assistance throughout the motion while pathway boundary refers to the virtual sensation matching the 
pathway throughout the operation. Novice mode, which is considered the easiest, assists nose boundary, 
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guidance force and pathway boundary. Similarly, intermediate mode assists the nose boundary and guidance 
force. The advanced mode is the most challenging as it only grants assistance for the nose boundary while 
further navigation is unassisted and relies entirely upon the user. The simulator system collects the data for 
each training by recording the time required to complete a practice, error score during the practices, and 
transmit all these data to store on a computer. 


Table 1. Criteria for categorizing practice mode of the simulator 
Nose Boundary Guidance Force Pathway Boundary 


Novice Mode / 7 / 
Intermediate Mode / / X 
Advanced Mode / X X 


Error score is calculated from the collision of the haptic tooltip with the cross-section path along the 
path boundary, which is masked as a transparent object in Unity3D. In (1) is used for the simulator error 
score calculation. 


Èn-1 nae (1) 


Score = 


where; 

C=collided path 

n=number of sample 

S=radius of each cross section 

T=total number of cross section path 

Note* Out of area will concern as max distance from pathway line 


2.7. Experimental design for testing novel design 

The interchangeable tooltip surgical tool function was tested with the surgical simulator via the 
pathway guidance. The haptic interact model consisting of the multi-surgic-tip tool was fabricated to 
interface the new surgical tool for the participant and neurosurgeons as shown in Figure 6. A test was 
conducted to perform a comparative assessment of the performance between the interchangeable surgical tool 
and conventional surgical tool through the simulator. A questionnaire was used to evaluate through a survey 
among the neurosurgeons who had experience with the EETS procedure, focusing primarily on the changeable 
tooltip function. In the survey, the questions were aimed at comparing the interchangeable tooltip surgical tool use 
in terms of satisfaction of the tool’s function with the EETS conventional tool as shown in Figure 7. 





Figure 6. The haptic interact model attached with the Phantom Omni haptic device’s stylus, developing into a 
multi-surgic-tip tool 


Within the interchangeable tooltip surgical tool, there are two movements: button sliding to use 
tooltip on each side and the handle griping for cutting. Therefore, the model has two sliding buttons and a 
gripping handle. The sliding button simulates the usage of the changeable function and the gripping handle 
assumes the cutting function. For interfacing with the haptic device, the model is attached to the Phantom 
Omni haptic device’s stylus. The stylus consists of two-button switches for sending the digital inputs to the 
simulator as shown in Figure 8. 

The stylus’s button operates with four communicated commands in which 2 switches are not in use, 
use switch A only, use switch B only, or use 2 switches. The electronic switches are applied in a multi- 
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surgic-tip tool model for detecting all the movements. The micro-switches are mounted into the model to 
detect the slide button movement and command the simulator to display the changeable tooltip function in 
virtual reality. The selected tooltip would penetrate out of the virtual tool. For the handle gripping movement, 
the pushbutton switch is used for detecting the griping handle when the tool is cut by the user. Similar to the 
changeable function, the cutting would be displayed in the simulator. 





Figure 7. Testing the interchangeable tooltip surgical Figure 8. Components in the haptic interact model; 


instrument function with an EETS simulator and the micro-switches for detecting sliding buttons and 
multi-surgic-tip tool with participants, the the pushbutton switch for detecting the handle 
neurosurgeons gripping movement 


3. RESULTS AND DISCUSSION 

The total number of trials performed amounted to 198 trials, with all the subjects completing the 3 
modes of the simulator. The analysis of the data gave the time to completion and the error score for each 
model. Using Gaussian distribution is represented in Figures 9-11. The three groups of data show the 
different training at the first, second, and third trials respectively. The trending of the data from the Gaussian 
plot shows that the standard deviation and the results are shown in Tables 2-4. 


3.1. Novice mode 

In this mode, the user can perform the fastest time compared to others due to the assistant of the 
pathway guidance system which consists of pulling force, pathway boundary, and nose boundary. These 
factors help the user to navigate and locate the area of the sphenoid sinus effectively as shown in Figure 9(a). 

When a virtual surgical tooltip collides with an invisible circular surface aligning along the pathway 
line, the error score can be calculated by (1) as mentioned before. Error score for each trial is represented by 
box plot in Figure 9(b) which shows that variance and mean of error can be decreased when trainee perform 
until the third trial as shown in Table 2. 


Gaussian Plot of Time to completion in Novice Mode 


Gauss Distribution 





Time(Seconds) 


(a) 


Figure 9. Novice mode, (a) Gaussian plot of time to completion 
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Box plot of Error score in Novice mode 
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Figure 9. Novice mode, (b) Box plot of error score (continue) 


3.2. Intermediate mode 

This mode allows the user to move the surgical tool freely within the nasal cavity by removing the 
pathway boundary. Therefore, this mode is more difficult than Novice mode as the user can even move to the 
wrong locations such as the esophagus or another nasal sinus. From the graph in Figure 10(a) and Table 3, it 
shows that the user performs the task longer than Novice mode which is supported by the slight increase in 
the mean and variance value. However, the system can assist the user by giving lower time for completion. 

The range of error score in Intermediate mode is more than Novice mode due to the complicated 
pathway after removes the pathway boundary as shown in Figure 10(b). Furthermore, the Table 3 shows that 
the mean and the variance value still decreased while practicing with the simulator. 


Gaussian Plot of Time to completion in Intermediate Mode 
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Box plot of Error score in Intermediate mode 
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Figure 10. Intermediate mode, (a) Gaussian plot of time to completion, (b) Box plot of error score 
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Table 2. Mean and variance of time to completion Table 3. Mean and variance of time to completion 
and error score in novice mode and error score in Intermediate mode 
Novice mode Trial#l Trial#2 Trial #3 Intermediate mode Trial#l1 Trial#2 Trial #3 
Time to completion in Novice mode Time to completion in Intermediate mode 
Mean 71.18 57.13 46.92 Mean 95.68 85.63 74.13 
Variance 604.25 271.45 105.13 Variance 292.41 221.19 206.50 
Error score in Novice mode Error score in Intermediate mode 
Mean 75.39 68.36 58.32 Mean 88.60 79.86 72.62 
Variance 81.24 TTT 71.24 Variance 62.40 85.77 82.30 


3.3. Advanced mode 

Pathway boundary and pulling force have been removed for this mode to allow the user to practice 
under an environment similar to that of real surgery. The result from this mode shows that the trainee spends 
more time according to Figure 11(a), where the base of the Gaussian plot extends more than the other modes. 
The mean and the variance value declined as shown in Table 4. 

Error score in advance mode can be described by Figure 11(b), which shows significant variation in 
the size of the box plots for each trial. The difficulty of this mode made the trainee move the surgical tool out 
of the appropriate EETS pathway. There is some sample that trainee got the highest error which is considered 
as the outlier of the data. According to Table 4, the mean error score decreased, while on the other hand, the 
variance has increased due to the trainee becoming unaware of the complicated pathway. The main way to 
solve this problem is through relentless practice within the system. 


Gaussian Plot of Time to completion in Advance Mode 
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Box plot of Error score in Advance mode 
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Figure 11. Advance mode, (a) Gaussian plot of time to completion, (b) Box plot of error score 
3.4. Interchangeable tooltip surgical tool 
The experimental result of the interchangeable tooltip surgical tool is presented in Table 5 from the 


evaluation survey with 7 neurosurgeons who were experienced in the EETS procedure. The result of the test 
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pertaining to the EETs simulator and the multi-surgic-tip tool has been quantified in terms of percentage 
based on different criteria such as size and shape, the convenience of using the sliding switch, and gripper, 
interchangeable function, and ergonomics. 


Table 4. Mean and variance of time to completion Table 5. Results from questionnaires which survey 
and error score in advance mode from the neurosurgeons 
Advance mode Trial#l  Trial#2 Trial #3 sas Mean satisfaction 
E T Description 
Time to completion in Advance mode score 
Mean 120.86 100.61 83.86 Size and shape of tool 62.80% 
Variance 1216.98 627.56 236.21 Convenience of using switch and 
. . 71.40% 
Error score in Advance mode gripper 
Mean 93.44 83.56 80.01 Interchangeable tool function 85.6% 
Variance 31.06 85.77 99.12 Practical use of design 771% 


Comparing with the conventional surgical tool from the participants’ experience, most of the topics 
in the questionnaire had a satisfaction rate of over 70 percentages, which shows the concept design of the 
interchangeable tooltip tool to be acceptable in the EETS procedure. Regarding the satisfaction levels, the 
convenience of using sliding switch and gripper scored 71.40 percent, the interchangeable tooltip function, 
which is a novel function to participants scored 85.6 percent and the practical use had 77 percent. However, 
the lowest score was received by the size and shape aspect of the interchangeable tool which scored 62.80 
percentages of satisfaction. 


3.5. Cadaveric experiment trial 

A cadaveric experiment was performed to test the limitation of haptic rendering in Unity when using 
the high polygon of the haptic model as shown in Figure 12(a) in the real surgical environment. Unity will 
separate the mesh model to sub-level when the number of vertices is more than 65500. The plugin will work 
perfectly with the model which does not subdivide as shown in Figure 12(b), where the distance of each slice 
is equal to 3 mm in Z-axis of Unity. 








(a) (b) 


Figure 12. Cadaveric experiment trial, (a) Experiment setup, (b) GUI pathway cross-section arrangement 


4. CONCLUSION 

In this paper we propose to develop a novel surgical simulator designed for the insertion of the 
EETS tool based on average pathway model and haptic feedback, starting from the nostril until the area of 
the sphenoid sinus. The system adheres to the virtual reality (VR) technology for the interaction between the 
user and the haptic device, while exchanging the force feedback and visual data during the performance of 
the simulation. As a result, the interaction between the user and the haptic device can increase the experience 
level by decreasing the time of completion and the error score from the simulator system. Also, the 
interchangeable tooltip surgical tool test demonstrated that it can perform all the prescribed functions. 
Finally, it could be validated that the overall system can be used to support the neurosurgeon to overcome the 
issues they face in an EETS operation. The trend of the data shows that each mode can decrease error score 
and the time to completion after practicing at least three times. Therefore, the user can learn the motor control 
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of hand movement in order to reach the target at the Sphenoid sinus area via the pathway guidance system in 
the simulator. The pathway guidance system in the simulator can be applied with a robot navigation system 
to assist the neurosurgeon to handle the surgical tools. This can avoid touching the high-risk area in the nasal 
cavity and also reduce the time of EETS operation. 
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